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A METHOD FOR TIMING CONTROL 

FIELD OF THE INVENTION 

The present invention relates to imaging, particularly in vivo imaging, 
typically, by utilizing a CMOS image sensor. 

BACKGROUND OF THE INVENTION 

Image sensors are silicon chips that capture and measure an amount of 
light A typical CMOS (complementary metal-oxide semiconductor) image 
sensor can perform camera functions on-chip. 

Active pixel CMOS image sensors may contain a photo-detector element 
(a photodiode or a photogate) and an active transistor circuitry (an amplifier) 
integrated within the same substrate. During imaging, on chip timing and control 
circuits drive row and column electronics in cycles of light integration and 
readout followed by reset. 

CMOS image sensors are typically used in low- and mid- end video 
cameras, for industrial purposes e.g., in robots and in quality control and for 
domestic use e.g., in cameras connected to personal computers. 

In vivo imaging devices can utilize CMOS image sensors. For example, 
an in vivo imaging device may capture images of a body lumen and transmit the 
images to an external receiving system, while being moved along a body lumen. 
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SUMMARY OF THE INVENTION 

The present invention provides a method for imaging, typically in vivo 
imaging, that enables, inter alia, the obtaining of sharp images that are not 
blurred, from an in vivo CMOS image sensor. Further, the method according to 
an embodiment of the invention may enable transmission of images from the 
sensor by a low power, small dimension wireless transmitter. The method, 
according to an embodiment of the invention may enable imaging that is not 
impaired by dark signal noise, even in warm environments and variable light 
conditions, namely, with intermittent dark periods. 

As referred to herein, the term "dark period" relates to a time period in 
which no electrical energy, which is due to illumination, is added to the CMOS 
image sensor pixels. 

Also, as referred to herein an "in vivo CMOS image sensor" or "in vivo 
CMOS imager" relate to a CMOS image sensor that is obtaining images of a 
substantially non static scene. For example, the image sensor itself can be moving 
while it is obtaining images or the imaged scene may be moving (for example, a 
static or mobile image sensor imaging the contracting walls of the gastrointestinal 
(GI) tract or a static or mobile image sensor imaging a bleeding wound, etc.) 

The method, according to an embodiment of the invention, includes the 
step of providing pixels of an in vivo CMOS image sensor with at least one 
period of illumination and at least one subsequent dark period. 
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In one embodiment, the invention comprises a method for timing control 
of a CMOS image sensor. Typically, the CMOS imager may be a mobile imager, 
for example an in vivo image sensor that is actively or passively moved through a 
body lumen while obtaining images of the lumen. Alternatively, the CMOS 
imager may be static, e.g. used for monitoring body processes in the same 
location. According to an embodiment of the invention the method for timing 
control includes the following steps: a) providing pixels in a CMOS image sensor 
with at least one period of illumination and at least one subsequent dark period; 
and b) successively reading out and resetting each pixel during the dark period. 
The image sensor pixel circuitry may be inactivated during the period of 
illumination and activated during the dark period for pixel readout. 

The period of illumination and dark period together constitute the period 
in between frames, or the integration/readout cycle time. 

Further provided, according to an embodiment of the invention, is an in 
vivo imaging device that includes an in vivo CMOS image sensor having pixels 
that that are provided with at least one period of illumination and at least one 
subsequent dark period. 

Also provided, according to another embodiment of the invention, is an 
imaging device that includes a CMOS image sensor having timing circuitry that 
is programmed to effect successive readout and resetting of the image sensor 
pixels during a dark period only and to inactivate pixel circuitry during a period 
of illunfination. Thus, by utilizing the method and device of the invention an 
inexpensive miniaturized, battery powered imaging apparatus is attainable. Such 
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an apparatus may be advantageous in imaging ordinarily inaccessible or difficult 
to reach areas, for example, for imaging body lumens. 

In one embodiment the method and device of the invention may be used 
in a swailowable capsule to obtain images of a large portion of the GI tract. A 
wireless capsule comprising the imaging device of the invention, illumination for 
illuminating a site of interest in the GI tract and a transmitter for transmitting 
-images captured by the imaging device to an external receiving system, can 
perform as an autonomous endoscope for imaging the GI tract. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated more fully 
from the following detailed description taken in conjunction with the drawings in 
which: 

Figure 1 is a box diagram of the method according to an embodiment of 
the invention; and 

Figure 2 shows the timing diagram for readout according to one 
embodiment of the invention; and 

Figure 3 is a schematic longitudinal cross section illustration of an in 
vivo imaging device according to an embodiment of the invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

An embodiment of the method of the present invention is schematically 
illustrated in Fig. 1 . Referring to Fig. 1, in an in vivo CMOS image sensor having 
pixels, an illumination period is provided for the pixels (102), whereby light 
integration (and dark signal integration) takes place (101) in the pixels. 
Subsequently, a dark period is provided (104), e.g. by turning off the illumination 
or by covering the pixels so that they are unexposed to illumination. In alternate 
embodiments, other steps or techniques may be used according to the present 
invention, to provide a dark period. This sequence of steps produces one frame 
and may be repeated for obtaining as many frames as required. For example, the 
method, repeated m times, will result in m image frames. 

Typically, the CMOS image sensor is mobile. An imager comprising an 
in vivo CMOS image sensor according to embodiments of the invention, may be 
a miniaturized, low powered (e.g., battery powered) imaging apparatus, 
optionally capable of transmitting image data to an external receiving unit. In 
such an imaging apparatus energy considerations (or other considerations, such as 
bandwidth considerations, etc.) may require obtaining a typically small number 
of frames per time unit. Consequently, each frame may be obtained during a 
typically long exposure time, in which movement of the imager or of the imaged 
scene will result in blurry and not sharp images. According to an embodiment of 
the invention, the exposure time is reduced by providing, within an integration 
cycle, a dark period as well as a light period. The method may further include 
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the additional steps of successively reading out (106) and resetting (108) the 
pixels. 

In one embodiment, for example, in an image sensor having n pixels, all 
n pixels are illuminated simultaneously in an illumination period (102) whereby 
all the pixels are exposed to the same light integration time (101). Following the 
illumination period (102) all n pixels are exposed to a dark period (104) in which 
only integration of dark signal noise occurs (103). During the dark period the 
pixels are successively read out (106) and reset (108); pixel 1 is read out and 
reset, pixel 2 is read out following readout of pixel 1 and reset and so on until 
pixel n is read out and reset. This sequence of steps produces one frame and may 
be repeated for obtaining as many frames as required. The method, repeated m 
times, will result in m image frames. In alternate embodiments, only a portion of 
the pixels may be exposed to an illumination period and other steps and 
sequences of steps may be used according to the present invention. 

According to an embodiment of the invention, during the illumination 
period the underlying electronic system may be inactive while the photonic 
system of the pixel reacts to the illumination by light integration (dark signals are 
also being integrated). Typically, all the pixels are exposed to illumination for the 
same amount of time. Following the illumination period the pixels are exposed to 
a dark period (for example, either by turning off the illumination or by covering 
the pixels so that they are unexposed to illumination). No light integration occurs 
during the dark period, however the pixels are integrating dark signal noise. 
During the dark period the electronic system is activated for readout and resetting 
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of the pixels. The repetitive nature of the imager operation ensures that each pixel 
is exposed to the same amount of dark signal integration time (this point is further 
illustrated in Fig. 2). 

In alternate embodiments, other sequences may be used. For example, in 
an alternative embodiment, the readout and reset of the pixels can be performed 
continuously, with no special sequence, during the exposure period. In this 
embodiment the exposure and illumination occur during readout and reset of 
some of the pixels. Typically, these pixels are not used further for obtaining valid 
image information, while all other pixels can be used for obtaining valid 
information. 

As discussed above, providing intermittent, short periods of illumination 
enables the obtaining of images with less or without a blurring effect, even during 
movement of the image sensor or movement of the imaged scene. Readout and 
resetting of each pixel individually during a dark period may ensure that all the 
pixels are exposed to the same amount of dark signal integration. The typically 
equal exposure time to dark signal integration helps to ensure a consistent 
baseline noise for all the pixels, enabling to produce a significant signal. For 
example, in order to eliminate noise, a dark frame may be subtracted from every 
image frame. However, in an embodiment of the method of the invention, since 
the baseline dark signal noise remains more or less consistent, it is possible to 
obtain noise free image frames with out subtracting dark frames. In alternative 
embodiments different pixels may be exposed to different integration times. In 
this case the pixels may still be exposed to the same illumination period, typically 
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resulting only in different integration time during the dark period. In another 
embodiment different pixels may be exposed to different illumination periods. In 
this case different output may be obtained from different pixels, while being 
exposed to the same scene. In this case a normalization algorithm may be 
implemented in image post-processing. 

Embodiments of the method of the invention are beneficial, inter alia, for 
use in obtaining images from ordinarily inaccessible or difficult to reach areas, 
such as in miniaturized manufacturing processes, in geological surveys or in 
imaging in vivo. For example, embodiments of the invention may be used in a 
swallowable capsule to obtain images of large sections of the gastrointestinal (GI) 
tract as will be further described with reference to Fig. 3. 

The timing diagram for readout according to an embodiment of the 
invention is presented in Fig. 2. Referring to Fig. 2, readout of individual pixels 
typically begins in the dark period, directly after an illumination period. 
Immediately following readout of pixel 1 (line 1) pixel 1 is reset (line 2) and, 
simultaneously, pixel 2 is readout (line 3) and reset (line 4), and so on until pixel 
n, which is the last pixel in the pixel array of the image sensor, is readout and 
reset. In one embodiment there are, for example, 256x256 pixels in the pixel 
array; other dimensions may be used. The pixels are typically, but not necessarily, 
read out in order of their rows. Other steps or series of steps may be used, and 
other timing sequences may be used. 

In one embodiment, a period of illumination together with the subsequent 
dark period define a frame. In an imaging device taking, for example, 2 
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frames/second the illumination period is typically 10 - 100 ms and the dark 
period is typically 400 - 480 ms. Other sequences and lengths of time may be 
used, and other readout rates may be used. 

During the period of illumination light integration^ (and dark signal 
integration) may occur in all the pixels for the same amount of time. During the 
dark period each pixel may be exposed to dark signal integration before and after 
its readout and reset. Although the readout points in time are typically different 
for every pixel, the distance between two points of readout on a pixel is typically 
the same for all the pixels (e.g., distance a is equal to distance b). This helps to 
ensure that each pixel in the image sensor has the same amount of dark signal 
integration time, thereby lowering the variation in the dark signal noise generated 
by each pixel. 

Reference is now made to Fig. 3, which illustrates an in vivo imaging 
device utilizing the method according to an embodiment of the invention. The 
device, which may be wireless, comprises a CMOS image sensor, an illumination 
source for illuminating a site of interest in vivo and a transmitter for transmitting 
images captured by the image sensor to an external receiving system. Other 
arrangements of components may be used, and the system and method of the 
present invention may be used with other devices. 

Device 30 typically comprises an optical window 31 and an imaging 
system for obtaining images from inside a body lumen, such as the GI tract. The 
imaging system includes an illumination source 33, such as a white LED, a 
CMOS imaging camera 34, which detects the images and an optical system 32 
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which focuses the images onto the CMOS imaging camera 34. The illumination 
source 33 illuminates the inner portions of the body lumen through optical 
window 31. Device 30 further includes a transmitter 36 and an antenna 37 for 
transmitting the video signal of the CMOS imaging camera 34, and a power 
source 35, such as a silver oxide battery, that provides power to the electrical 
elements of the device 30. 

A device that may be suitable for use with embodiments of the invention 
is described in WO 01/65995, which is assigned to the common assignee of the 
present invention and which is hereby incorporated in its entirety by reference. 

Typically, the device 30 is capsule shaped, can be easily swallowed and 
may passively pass through the entire GI tract, pushed along by natural 
peristalsis. Nonetheless, it should be appreciated that the device may be of any 
shape suitable for being inserted into and passing through a body lumen or cavity. 
Furthermore, the device according to an embodiment of the invention may be 
attached or affixed on to an instrument that is inserted into body lumens and 
cavities, such as on an endoscope, laparoscope, stent, needle, catheter etc. 

Thus, the device may be introduced into a body lumen or cavity by 
swallowing, by using an endoscopic device, by surgery, etc. 

The device 30 images the GI tract while being moved along by peristalsis 
and transmits the signals obtained on a battery powered transmitter. The 
transmitter 36 may be, for example, an ASIC (application specific integrated 
circuit) operating on a frequency shift keying (FSK), phase shift keying (PSK) or 
minimum shift keying (MSK) modulation system to transmit digital signals 
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through an antenna 37 on radio frequency to an external receiving system. The 
transmitter 36 may include a control logic block for communicating with the 
imager and an illumination source power and control block for controlling the 
illumination. In one embodiment, the control logic block maintains a master 
clock, is synchronized by bit rate data and frame rate, and through a control, 
which may be generated by the imager, triggers the illumination source power 
and control block. The control logic block may further control the master clock 
and other imager parameters. An alternative embodiment may include a dedicated 
controller, which is not part of a transmitter. 

The illumination source 33 of the capsule is typically programmed to 
illuminate short flashes of light in predetermined intervals. In between the 
flashes, the body lumen is dark. Typically, every flash enables acquisition and 
subsequent transmission of one frame. 

According to one embodiment the CMOS image sensor 32 includes 
pixels containing a photo-detector element and readout circuitry, resetting 
circuitry and timing circuitry. The timing circuitry, that is coordinated with the 
operation of the illumination source 33, is programmed to effect successive 
readout and resetting of the pixels during the dark period only and to inactivate 
pixel circuitry during the period of illumination. Dark signal noise generated in 
imaging sensors increases in a temperature dependant manner. Slow sampling 
image sensors operating in warm environments, such as in vivo (e.g., 37°C), have 
to deal with a relatively large dark signal noise component. Part of the noise 
cancellation processes may involve having the amplifiers of the pixel begin 
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readout from the pixel only over an average value of dark signals. Variation in the 
dark signal noise generated by each pixel will cause an unsteady noise baseline, 
which will cause the production of a distorted image. As discussed in reference to 
Fig. 2, the embodiments of the invention may guaranty that each pixel in the 
image sensor has the same amount of dark signal integration time, thereby 
lowering the variation in the dark signal noise generated by each pixel. 

Embodiments of the invention are typically operative at a rate of 1 - 10 
frames per second with a CMOS image sensor having between 128x128 and 
512x512 pixels, preferably 256x256 pixels, and a transmitter transmitting video 
signals at a range of hundreds of MHz to GHz or about 1.35 Megabit per second; 
other frequencies may be used. The transmission is usually to a relatively closely 
located to a receiving system. Thus, an embodiment of the method and device of 
the invention can be operable at a power input as low as lOmW. 

It will be appreciated by persons skilled in the art that the present 
invention is not limited to what has been particularly shown and described 
hereinabove. Rather the scope of the present invention is defined only by the 
claims which follow: 
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CLAIMS 

LA method for timing control of a CMOS image sensor, the method 
comprising the steps of: 

providing pixels of the CMOS image sensor with at least one 
period of illumination and at least one subsequent dark period; and 

successively reading out and resetting each pixel during the dark 
period. 

2. The method according to claim 1 further* comprising the step of 
transmitting through a transmitter signals read out from the pixels to a 
receiving system. 

3. The method according to claim 1 wherein the step of providing pixels 
with at least one period of illumination and at least the one subsequent 
dark period is performed on all the pixels of the CMOS image sensor. 

4. The method according to claim 3 wherein the step of providing pixels 
with at least one period of illumination and at least the one subsequent 
dark period is performed on 256x256 pixels. 

5. The method according to claim 1 wherein the steps are repeated m times 
to obtain m image frames. 

6. The method according to claim 1 wherein the steps are repeated 1-10 
times per second to obtain 1-10 image frames per second 
correspondingly. 
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7. The method according to claim 6 wherein the steps are repeated 2 times 
per second to obtain 2 images per second. 

8. The method according to claim 2 wherein the step of transmitting 
signals is preformed during the subsequent dark period. 

9. The method according to claim 2 wherein the step of transmitting 
signals is preformed at a bandwidth of about 1.35 Megabit per second. 

10. An imaging device comprising a CMOS image sensor, at least one 
illumination source and a controller, 

said CMOS image sensor including at least: 
timing circuitry; 
resetting circuitry; and 
pixel circuitry, 

said timing circuitry configured to control the pixel circuitry to 
effect successive readout and resetting of pixels during a dark period 
and to inactivate the pixel circuitry during a period.of illumination; and 

said controller configured to communicate with the CMOS image 
sensor and to control the at least one illumination source. 

11. The imaging device according to claim 10 wherein the CMOS image 
sensor comprises 256x256 pixels. 

12. The imaging device according to claim 10 wherein the dark period is a 
period of about 400 - 480 ms and the period of illumination is a period 
of about 20-100 ms. 
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13. The imaging device according to claim 10 for use in imaging in vivo. 

H.The imaging device according to claim 10 for use in imaging the 
gastrointestinal tract. 

15. The imaging device according to claim 10 wherein the controller is part 
of a transmitter for transmitting images obtained by the CMOS image 
sensor. 

16The imaging device according to claim 10 wherein the transmitter 
controls the illuminations source to repeatedly illuminate for a period of 
about 20- 100 ms and to be shut off for a period of about 400 - 480 ms. 

17. A device for imaging the gastrointestinal tract, said device comprising 
at least one illumination source for illuminating a site in the 
gastrointestinal tract and at least one CMOS image sensor including at 
least: 

timing circuitry; 
resetting circuitry; and 
pixel circuitry, 

said timing circuitry controlling the pixel circuitry to effect 
successive readout and resetting of pixels during a dark period and to 
inactivate the pixel circuitry during a period of illumination. 

18. The device according to claim 17 further comprising a controller for 
controlling the CMOS image sensor and for controlling the illumination 
source. 
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19. The device according to claim 18 wherein the controller controls the 
illuminations source to repeatedly illuminate for a period of about 20 - 
100 ms and to be shut off for a period of about 400 - 480 ms. 

20. The device according to claim 18 wherein the controller is part of a 
transmitter for transmitting images obtained in the gastrointestinal tract. 

21. The device according to claim 18 wherein the device is a swallowable 
capsule. 

22. In an imaging device comprising a CMOS image sensor, an 
illumination source and a controller configured for communicating with 
the CMOS image sensor and controlling the illumination source, said 
CMOS image sensor including at least: 

resetting circuitry and pixel circuitry, 

a timing circuitry configured for controlling the pixel circuitry to 
effect successive readout and resetting of pixels during a dark period 
and to inactivate the pixel circuitry during a period of illumination. 

23. The imaging device according to claim 22 wherein the dark period is a 
period of about 20-100 ms and the period of illumination is a period of 
about 400 - 480 ms. 

24.1n an imaging device for in vivo imaging comprising a CMOS image 
sensor including at least: 

resetting circuitry and pixel circuitry, 
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a timing circuitry configured for controlling the pixel circuitry to 
effect successive readout and resetting of pixels during a dark period 
and to inactivate the pixel circuitry during a period of illumination. 

25. The imaging device according to claim 24 wherein the dark period is a 
period of about 20-100 ms and the period of illumination is a period of 
about 400 -480 ms. 

26. In an imaging device for imaging the gastrointestinal tract comprising a 
CMOS image sensor including at least: 

resetting circuitry and pixel circuitry, 

a timing circuitry configured for controlling the pixel circuitry to 
effect successive readout and resetting of pixels during a dark period 
and to inactivate the pixel circuitry during a period of illumination. 

27. The imaging device according to claim 26 wherein the dark period is a 
period of about 20-100 ms and the period of illumination is a period of 
about 400 - 480 ms. 

28. A method for in vivo imaging comprising the steps of: 

illuminating a site in vivo for at least one period of illumination; 

providing pixels of a CMOS image sensor in vivo with at least 
one period of illumination and at least one subsequent dark period; 

successively reading out and resetting each pixel during the dark 
period. 

29. A method for imaging the gastrointestinal tract comprising the steps of: 
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illuminating a site in the gastrointestinal tract for at least one 
period of illumination; 

providing pixels of a CMOS image sensor in the gastrointestinal 
tract with at least one period of illumination and at least one 
subsequent dark period; and 

successively reading out and resetting each pixel during the dark * 
period. 

30. The method according to claim 29 wherein the step of providing pixels 
with at least one period of illumination and at least the one subsequent 
dark period is performed on all the pixels of the CMOS image sensor. 

31. The method according to claim 29 wherein the step of providing pixels 
with at least one period of illumination and at least the one subsequent 
dark period is performed on 256x256 pixels. 

32. The method according to claim 29 wherein the steps are repeated m 
times to obtain m image frames. 

33 .The method according to claim 29 wherein the steps are repeated twice 
per second to obtain two image frames per second. 

34. The method according to claim 29 further comprising the step of 
transmitting signals read out from the pixels to an external receiving 
system. 

35. The method according to claim 34 wherein the step of transmitting 
signals is preformed during the subsequent dark period. 
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36. The method according to claim 35 wherein the step of transmitting 
signals is preformed at a bandwidth of about 1.35 Megabit per second. 

3 7. A method for in vivo imaging, the method comprising the step of: 

providing pixels of a mobile CMOS image sensor with at least 
one period of illumination and at least one subsequent dark period. 

3 8. The method according to claim 37 further comprising the step of 
transmitting through a transmitter signals read out from the pixels to a 
receiving system. 

39. An imaging device comprising a mobile CMOS image sensor, at least 
one illumination source and a controller, said controller is configured to 
control the at least one illumination source to illuminate for a first period 
and to be shut off for a subsequent period. 

40. The imaging device according to claim 39 wherein the first period is a 
period of about 20 - 100 ms and the subsequent period is a period of 
about 400 - 480 ms. 

41. The imaging device according to claim 39 wherein the controller is 
configured to control the at least one illumination source to repeatedly 
illuminate for a first period and to be shut off for a subsequent period. 



20 



WO 02/080376 



PCT/IL02/00253 



1/3 



PROVIDING l 1f>9 
ILLUMINATION PERIOD ^ uz 




LIGHT INTEGRATION 
(AND DARK SIGNAL 
INTEGRATION) 



-101 



PROVIDING DARK 
PERIOD 



-104 




DARK SIGNAL 
INTEGRATION 



-103 



~ 1 



READOUT OF 
PIXEL 1 



READOUT OF 
PIXEL 2 



106 



READOUT OF 
PIXEL n 



RESETTING 
OF PIXEL 1 



RESETTING 
OF PIXEL 2 



108 



RESETTING 
OF PIXEL n 



FIG.l 



SUBSTITUTE SHEET (RULE 26) 



WO 02/080376 



PCT/IL02/00253 



2/3 



O 
O 



o 

I— 
< 




C 



o 
o 



O 
5 



C\2 

I— i 



T - ' 

LI Q(/) 

x <y 
pr uj cr 



_J O LU 
UJ O 00 
s< < LU 

CL 



c 5k 

_J O LiJ 
UJ Q 00 
X < LU 



SUBSTITUTE SHEET (RULE 26) 



WO 02/080376 



PCT/IL02/00253 




FIG.3 



SUBSTITUTE SHEET (RULE 26) 



